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Dr.  John  W.  Moore,  Ph.D. ,  Principal  Investigator 
University  of  Massachusetts,  Amherst 

I  Summary 

Neurobiological  investigations  of  adaptive  neural  networks  were 
conducted  using  the  classically  conditioned  nictitating  membrane 
response  (NM  CR)  of  rabbit,  a  widely  used  model  system  for  studies  of 
learning.  One  experimental  approach  involved  recording  from  single 
brain  neurons  from  awake,  behaving  animals  for  the  purpose  of 
determining  the  loci  and  characteristics  of  neurons  with  activity 
correlated  with  the  NM  CR  or  its  inhibition.  A  second  approach  involved 
the  use  of  discrete  brain  lesions  that  selectively  eliminate  the  NM  CR 
while  at  the  same  time  sparing  the  basic  reflex  pathway.  A  third 
approach  employed  f iber-tracing  anatomical  techniques  designed  to 
clarify  the  interconnect! /ity  among  brain  regions  essential  for  the  NM 
CR.  These  regions  include  discrete  portions  of  the  cerebellum  and  brain 
stem.  Information  from  physiological  studies  has  been  incorporated  into 
mathematical  models  of  learning  used  by  adaptive  network  researchers, 
and  anatomical  findings  have  guided  the  development  of  related  neuronal 
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models 


II 


Research_Ob  ject  i.ves 


A.  Overview  The  project's  primary  objective  was  to  conduct 


neurobiological  studies  relevant  to  adaptive  networks  using  the 
classically  conditioned  nictitating  membrane  <NM)  response  as  a  model 
system.  The  classically  conditioned  NM  response  (NM  CR)  in  rabbit  has 
been  widely  adopted  as  a  model  system  -for  behavioral,  neurobiological, 
and  theoretical  studies  of  mammalian  associative  learning.  Previous 
reports  might  be  consulted  in  the  interest  o-f  continuity.  The  Research 
PC93!:ess_and_Forecast_ReBgrt  dated  11/27/84,  for  example,  contains ’a 
good  deal  of  information  detailing  the  rationale  for  our  theoretical  and 


experimetal  work  during  the  reporting  period.  That  report  describes 
some  relevant  scientific  interactions  that  are  only  briefly  noted  here. 

It  is  generally  held  that  many  brain  regions  contribute  to 
learning  the  NM  CR  and  that  these  regions  interact  with  each  other  via 


pathways  that  parallel  the  basic  reflex  pathway  underlying  the 
unconditioned  response  (UR).  Neural  circuits  responsible  for  the  CR 
converge,  on  the  response  side,  among  motoneuron  pools  that  retract  the 
eyeball,  principally  the  accessory  abducens  nucleus  (AAN) .  On  the 
stimulus  side,  rostral  elements  of  the  sensory  trigeminal  complex 
subserve  the  unconditioned  stimulus  (US).  A  comparatively  simple 
disynaptic  reflex  arc  completes  the  circuit  between  stimulation  of  the 
eye  and  defensive  retraction  of  the  globe.  NM  extension  is  a  passive 
consequence  of  eyeball  retraction.  Circuits  mediating  the  NM  CR  include 
discrete  portions  of  the  cerebellum  and  reticular  information.  These 
systems  appear  to  interact  with  other  brain  regions  that  modulate  the 
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rate  of  CR  acquisition,  CR  topography,  and  inhibition;  they  include  the 
septo-hippocampal  complex  and  poorly  differentiated  regions  of  the 
midbrain. 

Behavioral /biological  studies  of  learning  using  the  rabbit  NM 

preparation  have  implications  for  adaptive  network  research  because  they 

can  guide  and  validate  assumptions  underlying  mathematical  models 

learning.  Promising  models  suggest  algorithms  that  are  potentially 

applicable  to  problems  of  artificial  or  machine  learning.  In  addition, 

by  successfully  modelling  the  fine-grain  topographical  features  of  the 

learned  response  in  real  time,  our  efforts  would  appear  relevant  to 

problems  of  sensory  motor  control  in  two  domains:  physiology  and 

» 

robotics. 

We  were  particularly  interesced  in  the  model  described  in  1981 
by  Drs.  R.S.  Sutton  and  A.G.  Barto  of  the  Department  of  Computer  and 
Information  Sciences  in  connection  with  their  studies  of  adaptive 
networks  (R.S.  Sutton  &  A.G.  Barto,  Toward  a  modern  theory  of  adaptive 
networks:  Expectation  and  prediction.  Psychol.ggicalL_Reyiewj  1981,  88, 
135-170).  Our  group,  primarily  John  E. Desmond,  Dr.  N.E.  Berthier,  Diana 
Blazis,  and  myself,  have  developed  real-time  variants  of  this  model 
capable  of  predicting  patterns  of  neuronal  firing  and  CR  topography 
(latency,  amplitude,  and  form)  typically  observed  in  the  rabbit  NM 
preparation.  The  model  has  validity  for  a  variety  paradigms  and 
training  protocols.  This  effort  profited  from  interactions  with  Barto 
and  Sutton  and  other  experts  in  relevant  behavioral  domains,  principally 
E.  J.  Kehoe  and  my  colleague  J.  J.  B.  Ayres.  In  a  related  line  of  work, 
Nestor  Schmajuk  and  I  developed  attentional  models  of  associative 
learning,  derived  from  psychology,  into  computational  adaptive  networks 


capable,  not  only  describing  neural  correlates  of  learned  behavior  and 
CR  topography  in  real  time,  but  also  of  describing  the  contribution  of 
the  hippocampal  formation  to-  the  NM  CR  and  perhaps  other  instances  of 
learning. 

B.  EyCP9!se_g£_Seecif ic_Studi es  Specific  studies  during  the 
reporting  period  fall  into  four  main  categories:  electrophysiological , 
anatomical ,  lesions,  and  theoretical. 

1.  EL§ctrgE>hysi_ol  ogical.  Briefly,  our  physiological  studies 
involved  single  or  multiple-unit  extracel lular  recording  from  brains  of 
awake,  behaving  animals-.  We  now  rely  exclusively  on  single-unit 
methodology.  Their  purpose  was  to  -determine  the  precise  loci  and  firing 
pattern  of  neurons  with  activity  related  to  the  CR  or  its  inhibition. 
This  information  is  crucial  for  understanding,  not  only  which  brain 
regions  and  structures  are  involved  in  a  particular  aspect  of  the  CR, 
but  how  these  regions  and  structures  interact  to  perform  their 
designated  tasks.  Neuronal  representat i ons  of  these  processes  in  the 
form  of  connect i oni sti c  schemas  can  be  viewed  as  models  of  parallel 
cooperative  computation.  During  the  period  of  the  current  grant,  and 
with  funds  provided  by  NSF  and  NIH  in  addition  to  AFQSR,  we  have 
constructed  three  complete  computer — assisted  laboratory  for  single-unit 
neuronal  recording  concurrent  with  behavioral  testing  for  the  purpose  of 
investigating  the  relationship  between  neuronal  activity  and  the  NM  CR. 
One  laboratory  is  used  by  Neil  E.  Berthier,  another  by  John  E.  Desmond, 
and  the  third  by  William  6.  Richards.  These  three  individuals  are 
postdoctoral  associ ates/f el  lows.  Prior  to  the  current  grant ,  my 
laboratory  was  limited  to  one  el ectrophysi ol ogy  setup,  and  that  was  only 
capable  of  multiple-unit  recording. 
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Electrophysiological  studies  completed  over  the  grant  period 


include  two  doctoral  dissertation  projects,  one  of  which  has  been 
completed  and  the  Ph.D.  degree  awarded  (John  E.  Desmond)  and  the  other 
of  which  is  still  being  written  up  by  the  candidate  (Michael  Vigorito). 
In  terms  of  publications  involving  neuronal  recording,  one  paper 
(Berthier  &  Moore,  1986)  is  "in  press"  in  Experimental _Brain_Research 
and  another  (Desmond  ?<  Moore,  1986)  has  been  accepted  by  that  journal 
pending  revisions.  Results  of  these  studies  have  also  been  presented  at 
several  meetings  as  invited  talks  or  poster  presentations. 

2.  Anatomical  ;  Anatomical  studies  addressed  the 
interconnectivity  of  brain  structures  essential  for  the  NM  CR, 
especially  the  anatomical  relationships  among  the  accessory  abducen 
nucleus  (AAN) ,  the  principal  source  of  motor  control  the  NM  CR,  and 
magnocel 1 ul ar  red  nucleus  (RN) ,  an  essential  premotor  link  in  the 
circuit.  We  used  implanted  WGA-HRP  for  fiber  tracing  studies  designed 
to  verify  out-  previously  reported  findings  with  HRP  that  RN  projects  to 
AAN.  We  were  also  concerned  about  brain  stem  projections  to  AAN  from 
the  dorsolateral  pons  and  cerebellum.  This  research  is  in  its  final 
stages:  a  report  earmarked  for  publication  is  being  prepared  at  this 
time,  and  an  abstract  for  presentation  of  our  findings  at  the  next 
Society  for  Neurosciences  meeting  has  been  submitted.  Basically,  our 
findings  with  WGA-HRP  are  entirely  consistent  with  our  previously 
published  results  based  on  HRP. 

During  the  past  12  months  we  initiated  another  WGA-HRP  study 
designed  specifically  to  detect  the  existence  in  rabbit  of  an 
ipsilateral  descending  limb  of  brachium  conjunctivum  (BC)  terminating  in 
the  dorsolateral  pons.  As  a  possible  premotor  component  of  the  NM  CR, 
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element.  A  paper  describing  a  variant  of  the  S-B  model  suitable  for 
real-time  intratrial  features  of  the  NM  CR  and  associated  neural 
activity  is  in  press  in  iih§vi oural _Brain_Research  ,  and  the  work  will 
be  presented  this  summer  at  the  Cognitive  Science  Society  meetings.  A 
related  theoretical  approach  to  intratrial  descriptions  of  conditioning 
phenomena  was  developed  by  John  Desmond  will  be  presented  at  the  next 
Society  for  Neuroscience  meetings.  A  third  class  of  models,  derived 
from  attentional  theories  of  learning  and  incorporating  a  role  for  the 
hippocampus,  has  also  been  studied  through  simulation  experiments.  This 
line  of  research  has  culmintad  in  a  successful  Ph.D.  dissertation  by 
Nestor  Schmajuk,  one  published  report  in  Physi.gl.ggi.cal._Psychgl.ggy  ,  a 
manuscript  that  has  been  submitted  to  Psychgiggical _Revi ew  ,  and  a 
p’aper  that  will  shortly  be  submitted  to  Ihe_Journal _of_Ex per i mental 
Psychology  :._Animal_Behayi.gr_Prgcesses.. 

Over  the  past  year  we  have  worked  closely  with  other  theorists 
doing  related  work  on  conditioning:  A.  H.  Klopf,  R.  S.  Sutton,  E.  J. 
Kehoe,  and  J.  J.  B.  Ayres.  In  addition,  a  graduate  seminar  offerred  by 
me  during  the  past  semester  was  largely  devoted  to  theoretical  issues 
bearing  on  learning  algorithms  of  interest  to  adaptive  network 
researchers.  Although  intended  for  students,  the  seminar  also  attracted 
the  participation  of  several  colleagues. 


Ill  §t at us_gf_Re search 

A.  El  ectrgphysi o^ggi  cal  _Studi.es 

I  •  Anal.ysi  s_gf  _1  ear  ning_r el  at ed_singl_e_neur gns_gf_the_.br ain 
Stem  This  was  John  Desmond's  dissertation  project.  Extracellular 
recording  from  single  neurons  were  obtained  during  behavioral  training. 
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Most  sampled  units  were  located  in  pontine  reticular  formation.  The 
relationship  between  unit  firing  patterns  and  topographi cal  features  of 
the  CR  was  investigated  with  an  impressive  array  of  quantitive  tools 
developed  by  Desmond,  including  multiple  regression,  peristimulus  and 
periresponse  histograms,  and  time-correlograms.  Such  analyses  aided 
development  computational  models  models  of  learning  related  neuronal 
activity. 

Two  main  types  of  CR-related  neuronal  activity  were  observed. 
On-cells  increase  their  activity  so  as  to  mirror  aspects  of  CR 
topography  such  as  latency  and  amplitude.  These  neurons  form  a  template 
of  the  CR  as  much  as  100  msec  before  the  CR  begins.  Such  neurons  are 
either  causally  related  to  the  CR  or  else  they  reflect  processing  and 
representation  within  a  parallel  system,  as  portrayed  in  prp-'iously 
published  neuronal  models.  A  subset  of  neurons  with  CR-related  activity 
decrease  their  firing  rates  in  relation  to  the  NM  CR.  Desmond's 
dissertation  has  been  duplicated  as  a  technical  report  entitled  "The 
classically  conditioned  nictitating  membrane  response:  Analysis  of 
learning-related  single  neurons  of  the  brain  stem".  Sept.  1985. 

2.  Multiple— uni.t_corr  el  ates_gf -_cgndi  ti  oned_i.nhi  bi.ti.on  This 
study  is  Michael  Vigorito's  dissertation  project.  Its  methodology 
resembles  that  employed  in  the  Desmond  study,  except  that  multiple-unit 
recordings  were  the  rule  and  single  units  an  exception.  Certain 
theoretical  models  assume  that  Cl  develops  in  a  distinct  system  that 
parallels  those  involved  in  CR  acquisition.  Inhibition  of  a  CR 
presumably  arises  because  of  interactions  between  these  two  systems  at. 
some  as  yet  unknown  premotor  stage.  In  this  connection  it  is 
interesting  that  a  neuronal  i riterpretat i on  of  the  S-B  model  does  not 
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require  a  separate  system  in  order  to  generate  Cl.  Thus,  the  S-B  model 
cannot  be  construed  as  an  accurate  representation  of  how  Cl  emerges  in 
real  brains.  Nevertheless,  a  good  deal  of  our  simulation  work  with  S-B 
model  concerns  scenarios  that  lead  to  the  development  of  Cl  (or  negative 
"synaptic  weights"  in  the  model's  argot).  The  model  makes  interesting 
and  testable  predictions  about  Cl  in  scenarios  for  which  there  is  as  yet 
no  relevant  data. 

Recording  from  brain  regions  now  thought  to  be  important  for 
conditioned  inhibition,  but  not  for  acquisition  or  generation  of  the  NM 
CR,  Vigorito  observed  neurons  that  increased  their  firing  rate  as  the  CR 
was  actively  suppressed  in  the  presence  of  a  conditioned  inhibitc?. 

Units  of  this  type  were  observed  in  lateral  septal  nuclei,  lateral 
habenula,  and  ventromedial  thalamus.  By  contrast,  units  that  increase 
their  firing  in  the  absence  of  CRs* were  not  observed  in  Desmond's  study. 
Vigorito  left  this  laboratory  in  1984  to  pursue  professional 
opportunities  elsewhere.  Due  to  a  variety. of  personal  (family)  problems 
and  his  other  profession  commitments  in  research  and  yeaching,  he  has 
not  yet  completed  his  dissertation.  He  has  indicated  that  this  will 
been  done  this  summer,  as  he  has  taken  leave  from  his  present  positions. 

3.  Sinql  e-uoit.  recor^i ng_frc)ff>_,cerebel  l.ar_Purkin je_cel  Is  Nei  1 
Berthier  conducted  studies  showing  that  hemispheric  lobule  VI  of 
cerebellar  cortex  contains  Purkinje  cells  with  activity  related  to  the 
NM  CR.  Lesion  studies  have  shown  that  hemispheric  lobule  VI  is 
essential  for  the  NM  CR.  As  indicated  above  a  complete  desription  of 
this  work  to  date  will  appear  soon  in  Experimental _Brai.n_Research  .  For 
this  reason  •  I  have  omitted  a  detailed  summary  of  our  findings  here. 

B.  Anatomical  Studies 


Studies  of  the  interconnectivity  among  brain  regions  implicated 
in  the  NM  CR  were  conducted  using  WGA-HRP  (TMB)  as  a.  marker.  Because 
unilateral  lesions  of  magnocel lul ar  red  nucleus  (RN)  and  its  projections 
eliminate  the  NM  CR  on  the  side  opposite  to  the  lesion,  we  used  WGA-HRP 
to  determine  the  trajectory  of  two  of  the  primary  input/output  fiber 
systems  to  RN:  the  brachium  conjunctivum  (BC) ,  which  conveys  information 
from  anterior  nucleus  interpositus  of  the  contral ateral  cerebellar 
hemisphere;  the  rubrobulbar  tact,  which  carries  information  from  red 
nucleus  to  the  region  of  AAN  on  contral ater al  side  of  the  brain  stem.  A 
preliminary  description  of  this  work  has  been  published  in  Physiol ogy_S< 
§gb§yiori  The  principal  contribution  to  the  CR  from  RN  to  AAN  is  by  way 
of  interneurons  in  the  spinal  trigeminal  complex.  'Thus,  it  now  appears 
that  RN  exerts  the  greatest  part  of  its  control  over  the  NM  CR  by 
exciting  a  secondary  sensory  component  of  the  reflex  pathway  rather  than 
by  exciting  AAN  directly.  Nevertheless,  WGA-HRP  material  confirms  the 
existence  of  a  sparse  direct  projection  from  large  RN  cells  of  the 
dorso-medial  portion  of  RN  to  AAN,  as  described  in  a  previously 
published  HRP  study  from  this  laboratory. 

As  mentioned  above,  we  have  been  using  WGA-HRP  to  detect 
possible  ipsilateral  projections  from  cerebellar  nuclei  interpositus  and 
dentate  to  brain  stem  regions  implicated  in  NM  conditioning  by  Desmond's 
research.  According  to  reports  with  rats  and  monkeys,  such  ipsilateral 
projections  (the  descending  limb  of  BC)  are  more  likely  to  involve  the 
dentate  rather  than  interpositus  deep  nucleus.  We  implanted  WGA-HRP  in 
relevant  regions  of  the  pons  and  examined  dentate  and  interpositus  for 
retrograde  labelling  of  neuronal  somas.  In  addition,  we  implanted  the 
marker  into  deep  nuclear  zones  and  examined  the  pons  for  terminals  in 


the  regions  of  interest.  We  have  no  clear  evidence  that 

dentate/interposi tus  neurons  make  direct  ipsilateral  to  pontine  regions 
implicated  by  Desmond.  This  negative  evidence  supports  our  hypothesis 
that  the  essential  premotor  control  of  the  NM  CR  exerted  by  the 
cerebellum  cannot  account  for  Desmond's  results,  and  that  the 
dorsolateral  pons  participates  in  generation  of  CR  as  a  logical  AND 
GATE.  That  is,  two  seperate  neural  circuits  are  essential  for 
expression  of  the  CR;  one  involves  the  cerebellum,  and  the  other 
involves  the  pontine  reticular  formation.  The  two  circuits  both  receive 
CS  and  US  information,  but  they  only  converge  at  the  level  of 
motoneurons  (and  their  immediate  afferents  of  the  sensory  trigeminal 
complex)  associated  with  the  abducens  nerve.  Stated  somewhat 
differently,  because  as  their  repective  components  are  not 
interconnected  monosynapti cal  1 y ,  neither  circuit  can  be  regarded  simply 
as  a  slave  of  the  other.  The  processing  of  CS-US  information  necessary 
-for  learning  evidentally  occurs  in  parallel. 

We  are  undecided  regarding  suitable  venues  for  publication  of 
anatomical  studies  conducted  over  the  period  of  the  grant.  The  study 
focusing  premarily  on  the  relationship  between  RN  and  AAN  would  be 
perhaps  best  suited  for  Brain_Research_Ek.il leti n  because  this  is  where 
our  initial  study  on  this  subject  appeared.  That  journal  was  selected 
because  of  its  superior  reproduction  of  anatomical  material  and  emphasis 
on  behavioral  neuroscience.  The  study  on  the  descending  limb  of  EC, 
however,  will  probably  be  submitted  to  Experimental  ...Brair>_Research 
because  this  journal  has  become  a  highly  visible  outlet  for  quality  work 
on  rabbit  NM  conditioning,  and  it  is  the  journal  in  which  some  of  the 
evidence  for  a  descending  limb  of  BC  has  been  published. 


C.  Lesi gn_Studi es 

1 •  Lesions  of  brachium  con juncti vum _and_rubrgbulbar_tract 
Si.i(DiD3te_the_NM_CRi  As  noted  above,  unilateral  lesions  of  these  two 
fibers  systems  eliminate  the  NM  CR  but  not  the  UR.  Other  lesions  of  the 
dorsolateral  pons  caudal  to  the  abducens  nerve  have  no  effect  on 
behavior.  This  study,  which  was  conducted  by  technician  Marcy 
Rosenfield,  reinforced  our  earlier  conclusion  that  the  supratrigeminal 
reticular  formation,  like  the  cerebellum,  is  essential  for  the  NM  CR.  A 
description  of  this  work  has  been  published  in  Physig^Qgy_&_Behayi_gr .. 

2.  Bi  lateral._lesigns_gf  _hyggthal  amy§_dg_ngt_lmgai.r_cgndi.t  i  oned 
iQbifei.ti.Qn-.  Diana  Blazis,  a  graduate  student  in  my  laboratory  since 
9/84,  conducted  this  study  as  an  undergraduate  honors  thesis.  A  variety 
of  theoretical  consi derati ons ,  together  with  earlier  lesion  studies  by 
Moore  and  his  collaborators  here  arid  in  London,  suggested  the 
possibility  of  hypothalamic  involvement  in  Cl.  Blazis'  study  does  not 
support  this  hypothesis.  The  histological  material  suggested  that  the 
lateral  septal  area  and  habenula  may  be  involved  in  Cl.  This  hypothesis 
would  be  consistent  with  Vigorito's  recording  study  and  earlier  lesion 
studies  from  this  laboratory  involving  the  midbrain.  Blazis  and 
Rosenfield  initiated  lesion  studies  based  on  these  leads.  They 
investigated  effects  of  septal  area  lesions  on  Cl  and  began  to  extend 
these  studies  to  the  habenula.  However,  because  the  relationship 
between  lesions  of  these  brain  regions  and  disruption  of  Cl  was  these 
regions  and  Cl  was  less  than  clearcut,  I  suspended  this  line  of  research 
pending  completion  of  Vigorito's  dissertation. 

3.  Lesions,  that  disrupt  .the  NM..CR..dp,.not..af.fect.,the.,UfV  From  a 
variety  of  theoretical  perspectives,  the  extent  to  which  lesions  that 
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disrupt  the  CRs  might  also  influence  the  UR  is  an  important  issue.  For 
example,  certain  neuronal  models  suggest  that  CR-di srupting  lesions 
should  produce  a  slight,  but'  nevertheless  significant,  attentuation  of 
the  UR  over  a  range  of  intensities  of  the  eliciting  stimulus.  This  does 
not  appear  to  be  the  case.  Our  researchs  were  presented  at  the  1984 
Society  .for  Neuroscience  meetings  and  in  a  paper  by  Rosenfield  and 
myself  that  appeared  in  Behayioral__Brain_Research._ 

D.  Iheoretical_Studi.es 

1 •  Physiolggicaliy_cgnstrained_Suttgn-Bartg_learning_mgdelsi 
Literally  hundreds  of  simulations  experiments  were  conducted  in  efforts 
to  discover  variants  of  the  S-B  model  that  are  most  consistent  with 
behavioral  data  an  the  NM  CR.  This  work  has  been  largely  successful, 
and  published  descriptions  will  appear  in  Behayigura!_Brain_Research  , 
Proceedings  of  the  Cognitive  Science  Society  meetings  of  1986.  A 
preliminary  report  of  this  work  was  presented  at  the  1985  meetings  Df 
that  society..  Diana  Blazis  has  been  assessing  a  number  of  elaborations 
of  the  model  designed  to  enhance  its  ability  to  describe  NM  conditioning 
data  at  the  intra-  and  intertrial  levels. 

2.  Eb¥§i°l99iEaLlY_£SQstrained_attenti  gnal__mgdel.s  This  is 
basically  Nestor  Schmajuk's  dissertation  project,  which  was  successfully 
completed  this  past  semester.  He  and  I  performed  hundreds  of  simulation 
studies  and  prepared  three  papers  for  publication,  as  indicated  above. 

3.  John  Desmond  has  developed  a  two-element  neuronal  network 
model  and  set  of  algoritms  that  appears  to  to  be  a  considerable  advance 
on  the  basic  one-element  S-B  model.  Desmond's  model  is  applicable  to  a 
problem  that  has  not  been  addressed  by  any  other  model,  namely,  the 
problem  of  describing  and  simulating  the  real-time  topography  of  the  CR 
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that  results  when  animals  (or  people,  for  that  matter)  are  trained  under 
conditions  in  which  the  time  between  the  onset  a  CS  and  the  onset  of  the 
US  varies  from  one  trial  to  the  next.  Algoritms  like  Desmond's  that 
acquire  adaptive  motor  programs  when  the  timing  between  two  events 
varies  may  prove  useful  in  the  domains  of  AI  and  motor  control .  My 
colleague  A.  G.  Barto  believes  Desmond's  approach  may  be  applicable  to 
problems  of  motor  control  in  speech,  a  project  he  is  working  on  with  his 
post-doctoral  research  associate  Michael  Jordan.  Desmond's  work  will  be 
presented  at  the  meetings  of  the  Society  for  Neuroscience  this  fall. 

IV  Iechni.cal_Repgrts_J.Publ  i  cati  gns). 

1.  Moore,  J.W.  &  Solomon,  P.R.  Forebrai n-brai n  stem  interaction: 
conditioning  and  the  hippocampus.  In  L.  Squire  &  N.  Butters  (Eds.) 
NeurgEsychgiggy_gf_memgry_l  New  York:  Guilford,  19B4,  pp.  462-472. 

2.  Moore,  J.W.  Z<  Stickney,  K.J.  Anti associ at i ons:  Conditioned 
inhibition  in  attenti onal -associ at i ve  networks.  In  R.R.  Miller  ?<  N.E. 

Spear  (Eds.  )  Inf grmatign_prgcessi ng_in_animal.s: _ Cgndjt Jgned_inhi.bi.tign.. 

Hillsdale,  N.J.:  Erlbaum,  1985,  pp.  209-232. 

3.  Berthier,  N.E.  The  role  of  extraocular  muscles  in  the  rabbit 
nictitating  membrane  response:  a  reexamination.  Behayigurai_Br ajn 
Blfeerch4  1984,  14,  81-84. 

4.  Rosenfield,  M.E.  ,  Dovydaitis,  A.,  8<  Moore,  J.W.  Brachium 
conjunctivum  and  rubrobulbar  tract:  Brain  stem  projections  of  red 
nucleus  essential  for  the  conditioned  nictitating  membrane  response. 
EbYSiQlggy_8j_Behayi.gr ,  1985,  34,  761-76E). 

5.  Rosenfield,  M.E.  &  Moore,  J.W.  Red  nucleus  lesions  impair 
acquisition  of  the  classically  conditioned  nictitating  membrane  response 


but  not  eye-to-eye  savings  or  UR  amplitude.  Behavi gral__Brain_Researchj 
1985,  17,  77-81. 

A.  Schmajuk,  N.A.  &  Moore,  J.W.  Real-time  attentional  models  -for 
classical  conditioning  and  the  hippocampus.  Physiological  .Psychology.* 
1985,  13,  278-290. 

7.  Moore,  J.W. ,  Desmond,  J.E.,  Berthier,  N.E.,  Blazis,  D.E.J., 
Sutton,  R.S.,  S<  Barto,  A.G.  Connecti oni st i c  learning  in  real  time: 
Sutton-Barto  adaptive  element  and  classical  condition  of  the  nictitating 
membrane  response.  Proceedi_ngs_gf  _the_Seyenth_Annuai_Cgnf  erence_gf  _Jhe 
QQ9Qitiye_S£ience_Sgcietyi  1985,  318-322. 

8.  Moore,  J.W.  Two  model  systems.  In  Alkon,  D.L.  &  Woody,  -C.D. 
(Eds.)  Neural__mechanisms_gf  _condi_t  ioni  ng  x  New  York:  Plenum,  1985, 
209-219. 

9.  Berthier,  N.E.  &  Moore,  J.W.  Cerebellar  Purkinje  cell 
activity  related  to  the  classically  conditioned  nictitating  membrane 
response.  Exggr imental _Brai n_Researct*j.  In  press. 

10.  Moore,  J.W. ,  Desmond,  J.E.,  Berthier,  N.E.,  Blazis,  D.E.J., 
Sutton,  R.S.,  S<  Barto,  A.G.  Simulation  of  the  classically  conditioned 
nictitating  membrane  response  by  as  neuron-like  adaptive  element: 
Response  topography,  neuronal  firing,  and  i ntersti mul us  intervals. 

Behavi oural_Brai n_Research4  In  press. 

11.  Desmond,  J.E.  2<  Moore,  J.W.  Dorsolateral  pontine  tegmentum 
and  the  classically  conditioned  nictitating  membrane  response:  Analysis 
of  CR-related  single-unit  activity.  Exgerimental_Brain_Researchx 
Accepted  pending  revisions. 

V  Professional  Personnel 
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1.  John  W. Moore,  Ph.D.,  Professor  of  Psychology  (Neuroscience 
Behavior)  and  Associated  Professor  of  Computer  and  Information  Sciences. 

2.  Neil  E.Berthier,  .Ph.D.,  Research  Associate. 

3.  John  E.  Desmond,  Ph.D.,  Research  Associate.  Dr.  Desmond 
pursued  his  Ph.D.  in  this  laboratory  and  the  degree  was  awarded  Sept., 
1985.  His  dissertation  is  entitled  "The  Classically  Conditioned 
Nictitating  Membrane  Response:  Analysis  of  Learning-Related  Single 
Neurons  of  the  Brain  Stem."  Desmond  presented  his  findings  at  the  19B5 
meetings  of  the  Society  for  Neuroscience  and  the  Psychonomic  Society. 

4.  Nestor  A.  Schmajuk,  Ph.D.,  who  is  presently  at  the  Boston 
.  University  Center  for  Adaptive  Systems,  pursued  his  Ph.D.  in  this 

.  ^laboratory.  The  degree  was  awarded  May,  1986.  Hi  s' di ssertati on  is 
entitled  "Real-Time  Attentional  Models  for  the  Classically  Conditioned 
Nictitating  Membrane  Response." 

5.  William  G.  Richards,  Ph.D.,  NIH  post-doctoral  fellow. 

VI  Interactions 

A.  EQrmaI_PresentatigDI_by_Mggre_dur_i  ng_Year_Ihree 

1.  Invited  lecture  entitled  "Purkinje  cell  activity  related  to 
the  conditioned  nictitating  membrane  response".  Second  Biennial 
Symposium  on  Neural  Mechanisms  of  Conditioning,  King's  College, 
Cambridge  (U.K.),  Sept.  16-18,  1985. 

2.  Principal  participant  at  Fourth  Winter  Conference  on  Animal 
Learning,  Winter  Park,  Colorado,  Jan.  18-21,  1986. 

3.  Invited  participant  at  Tenth  Winter  Conference  on 
Neurobiology  of  Learning  and  Memory,  Park  City,  Utah,  Jan.  11-14,  1986. 

4.  Invited  lecture  entitled  "Purkinje  cell  activity  during  NMR 
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conditioning".  NATO  ARW  Workshop  Conference  on  Cerebellum  and  Neuronal 
Plasticity,  Magdalen  College,  Oxford  (U.K.),  April  7-9,  1986.  A  chapter 
will  be  published  with  the  proceedings  of  this  workshop  under  the  title 
"Cerebellar  and  Brain  Stem  Substrates  of  the  Classically  Conditioned 
Nictitating  Membrane  Response". 

5.  Colloquium  entitled  "Brain  Substrates  of  Conditioned  Response 
Learning".  University  of  Alabama,  Birmingham,  Alabama,  Oct.  1,  1985. 

6.  Peer  reviewed  poster  presentation  at  the  Seventh  Annual 

Conference  of  the  Cognitive  Science  Society,  Irvine,  California,  Aug. 
15-17,  1985.  . 

B .  Fgrmal_cpl.labgrati.gn 

1.  Douglas  Coulter,  working  in  Daniel  Alkon-'s  laboratory  at 
Marine  Biological  Laboratory,  Woods  Hole,  Mass.,  and  John  Disterhoft  of 
Northwestern  University  are  investigating  biophysical  properties  of 
hippocampal  pyramidal  cells  in  slices  from  rabbits  that  had  NM  CR 
training.  In  2/85,  I  provided  the  apparatus  they  are  now  using  for  the 
training  phases  of  these  experiments.  The  col  1 aborati on  has  resulted  in 
a  coauthored  paper  to  be  presented  at  the  1985  meetings  of  the  Society 
for  Neuroscience.  A  technical  report  of  this  work  is  being  prepared  at 
this  time. 

2.  Dr.  E.J.  Kehoe,  Ph.D. ,  of  the  University  of  New  South  Wales, 
Australia,  is  col  1 aborati ng  with  us  on  experiments  designed  to  test 
strong  predictions  of  various  learning  algorithms  derived  from  the 
Sutton-Barto  model . 

C .  i.nf  or  ma  1  _co  l  l  ab  or  at  i  ons 

1.  We  remain  in  close  contact  with  Dr.  C.  H.  Yeo  and  his  London 
col laborators  concerning  neural  substrates  of  the  NM  CR. 
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2.  Our  interactions  with  Dr.  A.  6.  Barto  and  with  group, 
including  Richard  Sutton,  now  at  GTE  in  Waltham,  Mass.,  continue.  The 
three  of  us  visited  Dr.  A.H.  Klopf  at  WPAFB  for  approximately  two  days 
this  past  Feb.  in  order  to  discuss  theories  of  classical  conditioning 
and  more  complex  forms  of  learning.  A  good  deal  of  time  was  devoted  to 
experiments  using  Dr.  Klopf 's  simulator.  John  Desmond,  Diana  Blazis  and 
I  visited  Dr.  Klopf  in  June  of  this  year  for  the  same  purpose. 

VII  New  Discoveries 

The  primary  new  discovery  during  the  reporting  period  concern 
CR-  related  single  unit  activity  in  brain  stem  and  cerebellar  cortex. 

The  demonstration  of  CR-related  single-unit  activity  in  cerebellar 
Purkinje  cells  is  particularly  noteworthy  because  it  supports  theories 
of  cerebellar  learning  of  Marr-Albus.  Also  noteworthy  is  our  failure  to 
find  anatomical  evidence  for  an  ipsi lateral  descending  limb  of  BC. 
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